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Abstract 

A new approach is proposed for finding the "best cut" in a hierarchy of partitions by 
energy minimization. Said energy must be "climbing" i.e. it must be hierarchically and 
scale increasing. It encompasses separable energies and those composed under supremum. 

1 Introduction 

The present not^ extends the results of |16| . which themselves generalize some results of L. 
Guigues' Phd thesis [6] (see also [5]). In [6], any partition, or partial partition, of the space is 
associated with a "separable energy", i.e. with an energy whose value for the whole partition 
is the sum of the values over its various classes. Under this assumption, two problems are 
treated: 

1. given a hierarchy of partitions and a separable energy w, how to combine some classes 
of the hierarchy in order to obtain a new partition that minimizes w? 

2. when a; depends on integer j, i.e. uj = co^ , how to generate a sequence of minimum 
partitions that is increasing in j, which therefore should form a minimum hierarchy? 

Though L. Guigues exploited linearity and affinity assumptions to lean original models 
on, it is not sure that they are the very cause of the properties he found. Indeed, for solving 
problem 1 above, an alternative and simpler condition of increasingness is proposed in [16j . 
After additional developments, it leads to the theorem 4 of this paper. The second question, 
of a minimum hierarchy, which was not treated in |16j . is the concern of sections 3 to 5 of 
the text. The main results are the theorem 1121 and the new algorithm developed in Section 
5, more general but simpler than that of [6j. It is followed by the two sections 6 and 7 about 
the additive and the V-composed energies respectively. They show that Theorem [12] applies 
to linear energies (e.g. Mumford and Shah, Salembier and Garrido), as well to several useful 
non linear energies (Soille, Zanoguera). 



^This work received funding from the Agence Nationale de la Recherche through contract ANR-2010- 
BLAN-0205-03 KIDIKO. 
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a) b) c) 

Figure 1: a) Basic input, h) and c) saliency maps from increasing watershed w.r.t. floodings 
by dynamics [6)] and by volume [c)[7j, [3|. 

2 Hierarchy of partitions (reminder) 

The space under study (Euchdean, digital, or else) is denoted by E, and the set of all partitions 
of E by T>q{E). Here a convenient notion is that partial partition, of C. Ronse [TI]. When 
we associate a partition vr(A) of a set A G V{E) and nothing outside A, then tt{A) is called 
a partial partition of E of support A. The family of all partial partitions of set E is denoted 
by T>{E), or simply by T> when there is no ambiguity. 

Finite hierarchies of partitions appeared initially in taxonomy, for classifying objects. 
One can quote in particular the works of J. P. Benzecri [2] and of E. Diday We owe to 
the first author the theorem linking ultrametrics with hierarchies, namely the equivalence 
between statements 1 and 3 in theorem [2] below. Hierarchies H of partitions usually derive 
from a chain of segmentations of some given function / on set E, i.e. from a stack of scalar or 
vector images, a chain which then serves as the framework for further operators. We consider, 
here, function / and hierarchy H as two starting points, possibly independent. This results 
in the following definition: 

Definition 1 Let T)q{E) he the set of all partitions of E, equipped with the refinement or- 
dering. A hierarchy H, of partitions tTj of E is a finite chain in Vq{E), i.e. 

H = {vTj, < i < n, VTj G Vq{E) \ i<k<n^TTi< tta,.}, (1) 

of extremities the universal extrema ofT>Q{E), namely ttq = {{x},x G E} and vr^ = E. 

Let Si{x) be the class of partition vTj of H at point x £ E. Denote by S the set of all 
classes Si{x) , i.e. S = {Si{x),x £ E,0 < i < n}. Expression ([1]) means that at each point 
x £ E the family of those classes Si{x) of S that contain x forms a finite chain Sx in V{E), 



2 



Figure 2: The initial image has been transformed by increasing alternated connected filters. 
They result in partitions into flat zones that increase from left to right. 




1"} {i} (c'l {i} {a} {/} {g} {h} {i} {J} {k} 



Figure 3: Left, hierarchical tree; right, the corresponding space structure, and 52 are the 
nodes sons of E, and H{Si) and H{Si) are the associated sub-hierarchies, vri and are cuts 
of H{Si) and H{Si) respectively, and tti U 7r2 is a cut of E. 



of nested elements from {x} to E : 

Sx = {Si{x),0 <i<n}. 

According to a classical result, a family {Si{x),x £ E,0 < i < n} oi indexed sets generates 
the classes of a hierarchy iff 

i < j and x,y e E =^ Si{x) C Sj{y) or Si{x) D Sj{y) or Si{x) D Sj{y) = 0. (2) 

A hierarchy may be represented in space E by the saliencies of its frontiers, as depicted in 
Figure [TJ Another representation, more adapted to the present study, emphasizes the classes 
rather than their edges, as depicted in Figur^SJ Finally, one can also describe it, in a more 
abstract manner, by a family tree where each node of bifurcation is a class S, as depicted 
in Figure [3l The classes of vrj-i at level i — 1 which are included in Si{x) are said to be the 
sons of Si{x). Clearly, the sets of the descenders of each S forms in turn a hierarchy H{S) 
of summit S, which is included in the complete hierarchy H = H{E). 

The two zones H{Si) and H{S2), drawn in Figure [3]in small dotted lines, are examples of 
such sub hierarchies. The following theorem |16] makes more precise the hierarchical structure 
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Theorem 2 The three following statements are equivalent: 

1. H is an indexed hierarchy, 

2. the set S of all classes of the partition vTj of H forms an ultrametric space, of distance 
the indexing parameter, 

3. every binary criterion a : {J-,S U 0) — t- {0, 1} is connective. 

This resuh shows that the connective segmentation approach is inefficient for hierarchies, 
and orients us towards the alternative method, which consists in optimizing an energy. 

3 Optimum partitioning of a hierarchy 

3.1 Cuts in a hierarchy 

Fohowing L. Guigues [6] [5], we say that any partition vr of -E whose classes are taken in 
S defines a cut in hierarchy H. The set of all cuts of E is denoted by n(£') = 11. Every 
"horizontal" section TTi{H) at level i is obviously a cut, but several levels can cooperate in a 
same cut, such as vr(S'i) and Tr{S2), drawn with thick dotted lines in Figure [3l Similarly, the 
partition 7r(5i) U 7r(S'2) generates a cut of H{E). The symbol U is used here for expressing 
that groups of classes are concatenated. It means that given two partial partitions '7r(5'i) and 
7r(52) having disjoint supports, vr(S'i) U 7r(52) is the partial partition whose classes are either 
those of 7r(S'i) or those of 7r(S'2). 

Similarly, one can define cuts inside any sub-hierarchy H{S) of summit S. Let n(S') be 
the family of all cuts of H{S). The union of all these families, when node S spans hierarchy 
H is denoted by 

U{H) = U{U{S),S eS{H)}. (3) 

Although the set Il{H) does not regroup all possible partial partitions with classes in 5, it 
contains the family Il{E) of all cuts of H{E). The hierarchical structure of the data induces 
a relation between the family Ti{S) of the cuts of node S and the families n(ri), ..,n(Tg) of 
the sons Ti, ..,Tg of S. Since all expressions of the form U{7r(Tfc); 1 < k < q} define cuts of 
S, n(S') contains the whole family 

n'(s) = {7r(ri) u ..TT{Tk).. u 7r(r,); 7r(ri) G n(ri)... 7r(r,) G n(rg)}, 

plus the cut of S into a unique class, i.e. S itself, which is not a member of n'(S'). And as 
the other unions of several Tk are not classes listed in 5, there is no other possible cut, hence 

n(s) = n'(s) u s. (4) 

3.2 Cuts of minimum energy and /i-increasingness 

In the present context, an energy uj : T>[E) — t- is a non negative numerical function over 
the family T>{E) of all partial partitions of set E. The cuts of n(S) C n of minimum energy, 
or minimum cuts, are characterized under the assumption of hierarchical increasingness, or 
more shortly of h-increasingness ^16j. 
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00 [7ri(T)] < CO [tt.W] w [ 7i:i(T) Utc^] < oj [7r,(T) UtTq] 

Figure 4: Hierachical increasingness. 



Definition 3 Let tti and 7r2 6e two partial partitions of same support, and ttq be a partial 
partition disjoint from tti and it2- An energy uj on T>{E) is said to he hierarchically increasing, 
or /i-increasing, in T>{E) when, 7ro,vri,7r2 G T>{E), ttq disjoint of tti and tx^, we have 

w(vri) < a;(7r2) =^ a;(7riU7ro)< a;(7r2U7ro). (5) 

An illustration of the meaning of implication ([5]) is given in Figure |H When the partial 
partitions are embedded in a hierarchy H, then Rel.(l5]) allows us an easy characterization of 
the cuts of minimum energy of K, according to the following property, valid for the class 'H, 
of all finite hierarchies on E 

Theorem 4 Let El he a finite hierarchy, and u be an energy on ^{E). Consider a node 
S of H with p sons Ti..Tp of minimum cuts tt^, ..it*. The cut of minimum energy of node S 
is either the cut 

ttIUttI.Utt;, (6) 
or the partition of uj into a unique class, if and only if S is h-increasing. 

Proof. We firstly prove that the condition is sufficient. The /i-increasingness implies of 
the energy implies that cut Q has the lowest energy among all the cuts of type n'(S') = 
\J{Tr(Tk); 1 < k < p} (it does not follow that it is unique). Now, from the decomposition 
every cut of S is either an element of 11' (5), or S itself. Therefore, the set formed by the cut 
([6]) and S contains one minimum cut of S at least. 

We will prove that the /i-increasingness is necessary by means of a counter-example. 
Consider the hierarchies of n levels in E = M."^, and associate an energy with the lengths of 
the frontiers as follows 

co{7t{S)) = u{Ti U ..r„.. UT,)= i9Tu), when (9r„) < 5 (7) 

uj{7r{S)) = {dTu) — 5 when not. 

l<«<g 

where {T„, 1 < u < q} are the sons of node S. Calculate the minimum cut of the three levels 
partition depicted in FigJSja) b) and c). The size of the square is 1 and one must take half the 
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Figure 5: a), 6),c): three levels of a hierarchy K. Partition a) is the minimum cut for energy 
([7]), which contradicts hierarchical increasingness. Partitions d) and e) are two minimum 
cuts of K for the sequence (jlSp of energies. They contradict scale increasingness. 



length for the external edges. We find iij(T\ UT2) = 3 and w(S') = 2. Hence 5 is the minimum 
cut of its own sub-hierarchy. So does S' . At the next level we have ijj(S U 5") = 4, and 
= 3. Nevertheless, E is not the minimum cut, because ioiTx VAT^^T'^VAT'^ = 6 — 5 = 1! 

■ 

The condition of /i-increasingness ([5]) opens into a broad range of energies, and is easy to 
check. It encompasses the case of the separable energies [B] [13], as well as energies composed 
by suprema [1] [T7] [19]. Computationally, it yields to the following Guigues' algorithm: 

• scan in one pass all nodes of H according to an ascending lexicographic order ; 

• determine at each node S a temporary minimum cut of H by comparing the energy of 
S to that of the concatenation of the temporary minimum cuts of the (already scanned) 
sons Tfc of S . 

3.3 Single minimum cuts 

It may happen that in the family n(S') of Relation (jH) a minimum cut of n'(5') has the same 
energy as that of S. This event introduces two solutions which are then carried over the 
whole induction. And since such a doublet can occur regarding any node S of H, the family 
M = M{H) of all minimum cuts may be very comprehensive. However, M turns out to be 
structured as a complete lattice for the ordering of the refinement, where the sup (resp. the 
inf) are obtained by taking the union (resp. the intersection) of the classes [16] . 

The risk of several minimum cuts w.r.t. a; may becomes sometimes cumbersome. Then 
one can always ensure unicity by slightly modifying a ^-increasing energy uj. Denote by m 
the minimum of all the positive differences of energies involved in the partial partitions of 
i.e. 

m = inf{a;(7r) - ^(vr'), a;(7r) < w(vr')} 7r,7r' e n(-H'). 

As the cardinal of H is finite, m is strictly positive. Therefore, one can find a e such as 
< e < m, and state the following: 
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Proposition 5 Let oo he a h-increasing energy over H. Introduce the additional energy oj' 
for all {tt{S) G U{S), S € S} 

co'lniS)] = e, niS) / {S} 
uj'[S] = 0, 

with < £ < m. Then the sum oj + lo' is h-increasing and associates a unique minimum cut 
with each sub-hierarchy H{S). When a;[7r*(S')] ^ uj[{S}], then the minimum cut for ui -\- ui' 
is TT*{S), and it is {S} itself when {S} and it*{S) have the same u-energy. 

uj[tt*{S)]^uj[{S}] TT*{S) best cut (8) 

uj[tt*{S)]=oj[{S}] {S} best cut 

Proof. Let us denote by small letters the main inequalities of the proof 

(a) uj{tti) < uj{tt2) 

(b) U ttq) < uj{Ti2 U ttq) 

(c) W(7ri) + Uj'{tIi) < UJ{'K2) + 0j'{'K2) 

(d) Uj{tTi U TTo) + Uj'{lTl U VTo) < Uj{lT2 U TTq) + Oj' {tT2 U TTq) 

We suppose that (a) =^ (6), and must prove that then (c) =^ (d). Let Sq be the support of 
partition ttq. Note firstly that the equalities u;'{tti Uttq) = u;'(tt2 U vto) = £ always hold, since 
vTi U VTo 7^ {5 U 5o} and 7r2 U ttq 7^ {5 U ^o}. Distinguish three cases: 

1/ TTi / {S} and 712 + {S}. Obviously, (c) ^ (a) ^ (6) ^ (d); 

2/ vri / {5} and vrz = {S). Again, (c) ^ (a) ^ (6) ^ (d); 

3/ TTi = {5} and t\2 7^ {S}. Inequality (c) becomes a;(7ri) < a;(7r2)+ e. If a;(7ri) > a;(7r2), 
then f:i^('7ri) > a;(7r2) + m- > a;(7r2) + e, which is impossible, hence a;(7ri) < lo{'K2)- This implies, 
as previously, (6) and then (c). ■ 

Note that the impact of w' is reduced to the case of equality a;[7r*(S')] = a;[{5}], and that 
a;+ ijj' can be taken arbitrary close to cj, but different from it. Proposition [5] turns out to be 
a particular case of the more general, and more useful result 

Corollary 6 Define the additive energy oj' by the relations 

a;'[7r(S')] = e, when tt{S) ^ {S} and ujItt^S)] < ujq 

uj'[tt{S)] = 0, when vr(5') = {S} and uj['it{S)] < loq 

a;'[7r(S')] = e, when 7r(S') = {S} and a;[7r(S')] > ojq 

uj'[tt{S)] = 0, when vr(S') / {S} and uj[tt{S)] > ujq. 

Then w + is h— increasing and always leads to a unique optimum cut. 
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Proof. When a;[7r(5)] < uq, we meet again the previous proposition [5i When a;[7r(S')] 
> loq, then we still have the triple distinction of the previous proof, the only difference being 
that case 2/ and 3/ are inverted, which achieves the proof. ■ 

Unlike in Proposition [5l in case of equality (x>[7r*(5)] = the optimum cut is now 

{S} when u;[7r(S')] < and tt*{S) when not. Corollary [U] is used for example for proving 
that Soille's energy is /i-increasing in section 17.11 below. 

The result (l8|) is a top-down property: 

Proposition 7 Let it*{E) be the single minimum cut of a hierarchy H w.r. to a h-increasing 
energy oj, and let S be a node of H. If ■k*{E) meets the sub-hierarchy H{S) of summit S, 
then the restriction 7r*{S) of 'k*{E) to H{S) is the single minimum cut of the sub-hierarchy 
H{S). 

Proof. We have to prove Relation ([8]). If vr*(S') = S, then the relation is obviously 
satisfied. Suppose now that the restriction 7r*(5) is different from S, and that there exists 
a cut ttq of S with a;(7ro) < a;(7r*(S')). Denote by vr" the partial partition obtained when 
7r*(5) is removed from ■n*{E). The /i-increasingness then implies that oo{ttq U tt") < ljj{S U 
7r~) = ijj{tt*{E)). But by definition of 7r*{E) we also have the reverse inequality, hence 
u}{tto Uvr") = u;{tt*{E)). Now, this equality contradicts the Relation ([5]) applied to the whole 
space E, so that the inequality a;(7ro) < w(7r*(5)) is impossible, and w(7ro) > a;(7r*(5)) for all 
7roGn(5). ■ 

3.4 Generation of /i-increasing energies 

As we saw, the energy w : T){E) — )• is defined on the family T>{E) of all partial partitions 
of E. An easy way to obtain a /i- increasing energy consists in defining it, firstly, over all sets 
S G 'P{E), considered as one class partial partitions {5}, and then in extending it to partial 
partitions by some law of composition. Then, the /i-increasingness is introduced by the law 
of composition, and not by u\P{E)]. The first two modes of composition which come to mind 
are, of course, addition and supremum, and indeed we can state 

Proposition 8 Let E be a set and uj : V{E) — )• an arbitrary energy defined on V{E), and 
let TT G T^{E) be a partial partition of classes {Si, 1 <i <n}. Then the the two extensions of 
u to the partial partitions T>{E) 

u{it) = V{uj{Si), 1 < i < n} and (^(vr) = X^{<^(5'i), 1 < i < n} 

are h-increasing energies. 

We shall study these two models in sections E] and [3 when they depend on a parameter 
leading to multiscale structures. A number of other laws are compatible with /i-increasingness. 
Instead of the supremum and the sum one could use the infimum, the product, the difference 
sup-inf, the quadratic sum, and their combinations. Moreover, one can make depend uj on 
more than one class, on the proximity of the edges, on another hierarchy, etc.. 
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3.5 Stucture of the /i-increasing energies 

We now analyze how different /i-increasing energies interact on a same liierarcliy. Tlie family 
n of all mappings oj : T> — t-M^ forms a complete lattice where 

uj < u' <^ (^{tt) < uj'{7r) for all vr G P 

and whose extrema are uj{7r) = and w(7r) = +00. What can be said about the sub class 
of C $7 of the /i-increasing energies? The class O' is obviously closed under addition and 
multiplication by positive scalars, i.e. 

{uj^} C n', Xj>0 EAjW^' G ^' (9) 

Consider now a finite family {uji,i G /} in Q' such that, for ttq, tti, 7r2 S T>{E), ttq disjoint 
of vTi and tt2, we have 

^ii-n-i) <ojj{TT2) =^ ^i(vriU7ro)< Wj(7r2U7ro), ttq, tti, 7r2 G P (10) 
a relation that generalizes the /i-increasingness ([5]). 

Proposition 9 The family of those energies that satisfy implication il(J\} is a finite sub-lattice 
of and for any family {uJi,i S /} in Q' we have 

{^OJi){^:) < {^UJ^){^:') {Auj,){tt U ttq) < (Aa;i)(^' U ^0) (H) 

(V6Ji)(7r) < (VW,)(^') {\/UJi){TTUTTo) < (Vl^i) U ^q) (12) 

Proof. Consider a family {uji,i G 1} which satisfy the /i-increasingness (jlOp . Suppose 
that (Aa;j)(7r) < (AcJi)(7r'), and let io be the parameter of the smallest of the a;j(7r). Then 
we have coioiTr) < Ui{'i:'),i G /, hence, from Rel. ffTO]) . a;io(7r U tto) < Wj(7r' U vro), so that 
cjip (tt U ttq) < (Aa;i)(7r' U TTo), and finally (Aa;i)(7r U vro) < (AtJj)(7r' U vro). Energy (Acjj) is thus 
/i-increasing. Same proof for the supremum. ■ 

Note that the infimum cut 'K/\uJ^ related to energy Acj, is not the infimum Avr^. of the 
minimum cuts generated by the Wj. It has to be computed directly (dual statement for the 
supremum) . 

4 climbing energies 

The usual energies are often given by finite sequences {oj^ ,1 < j < p} that depend on 
a positive index, or parameter, j. Therefore, the processing of hierarchy H results in a 
sequence of p optimum cuts vr-^*, of labels 1 < j < p. A priori, the tt^* are not ordered, but 
is they were, i.e. if 

j<k ■K^*<TT^\ j,keJ, 

then we should obtain a nice progressive simplification of the optima. We now seek the 
conditions that permit such an increasingness. 
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Consider a finite family of energies {uj^ , 1 < i < p} on all partial partitions T>{E) of set 
E , and apply these energies to the partial partitions n(i/) of hierarchy H (Relation 
The family {w-'l, not totally arbitrary, is supposed to satisfy the following condition of scale 
increasingnessio 

Definition 10 A family of energies {u}^,l < J < p} on T>{E) is said to be scale increasing 
when for j < k, each support S £ S and each partition vr G n(S'), we have that 

j <k and J{S) < oj^tt) uj''{S) < u}^{7r), S G V{E). (13) 

In case of a hierarchy H, relation ()13p means that, if 5 is a minimum cut w.r. to energy 
io^ for a partial hierarchy 11(5'), then S remains a minimum cut of Il{S) for all energies io^, 
k > j. As j increases, the w-^'s preserve the sense of energetic differences between the nodes 
of hierarchy H and their partial partitions. In particular, all energies of the type uj^ = juj 
are scale increasing. 

Axiom (jlSp compares two energies at the same level of H, whereas axiom ([5]) allows us to 
compare a same energy at two different levels. Therefore, the most powerful energies should 
to be those which combine scale and /i-increasingness, i.e. 

Definition 11 We call climbing energy any family {a;-', 1 < j < p} of energies over U which 
satisfies the three following axioms, valid for uj^ ,1 < j < p and for all vr S 11(5), 5 E 5 

• i) /i-increasingness, i.e. relation^: 

LO^TTl) < LO^ {112) =^ W-' [(VTI U TTq] < [(7r2 U TTq] , TTl, 7T2 £ H {S) 

• a) single minimum cutting: 

either u}^[7r*{S)] < J{7r), or 7r*(5) = 5, 

• Hi) scale increasingness, i.e. relation ll3\) : 

j < k and (5) < oj^ (vr) =^ uj 

Under these three assumptions, the climbing energies satisfy the very nice property to 
order the minimum cuts with respect to the parameter j, namely: 

Theorem 12 Let {lo^ , 1 < j < p} be a family of energies, and let tt^* (resp. tt^*) be the 
minimum cut of hierarchy H according to the energy oj^ (resp. u^). The family {tt^* ,1 < j < 
p} of the minimum cuts generates a unique hierarchy H* of partitions, i.e. 

j <k TT^* < vr^*, l<j<k<p (14) 

if and only if the family {uj^ } is a climbing energy. 

^Scale increasingness is called by L.Guigues "partial causality" in [6], p. 161, where it appears as a conse- 
quence and not as a starting point. 
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Proof. Assume that axiom iii) of a climbing energy is satisfied, and denote by and 
the two classes of vr-'* and vr'^* at a given point x. According to Rel.([2|), we must have either 
gj Q or S'' C . We will prove that the second inclusion is impossible. Suppose that 
class S''^ C . Then the restriction of the minimum cut tt^* to generates a cut, ttq say, 
of . According to proposition [71 which involves axioms i) and ii) of a climbing energy, the 
restriction ttq is in turn minimum for the energy over n(S'-'), i.e. uj^{itq) < uo^{S^). This 
implies, by scale increasingness, that uj^{ttq) < uj^{Sj) (here Relation (|13p has been red from 
right to left). But this inequality contradicts the fact that is a minimum cut for its own 
hierarchy H[S^). Therefore the inclusion C is rejected, and the alternative inclusion 
gj Q -g satisfied whatever x ^ E, which results in tt^* < vr'^*. Moreover, because of the 
single minimum cutting axiom, each n^* being unique, so does the whole hierarchy H* . 

The "only if statement will be proved by means of a counter-example. The notation is 
the same as in system ^ but we add a term for the areas and we replace the length dT^ of 
the frontier of each by the length dhorTu (resp. dvertTu) of the horizontal (resp. vertical) 
projection of the said frontiers if j < jo, (resp. if j > jo). 

ujH^S)) = a;(Ti U ..T„.. U T,) = 4 ^ {areaT^f + 2 ^ [dhorTu), when j < jo (15) 
Lu^{7r{S)) = uj{Ti U ..Tu-. UTg) = A ^ {areaTuf + 2 ^ (dvertTu), when j > jo, 

l<u<q ^^u<q 

(border lengths being divided by 2). For each value of j, the energy is /i-increasing, and 
one can apply proposition [5] for ensuring unicity. However, if j < jo then u}{Ti U T2) = 
6,uj{T[ U T2) = 4:,u}{S) = w(S") = 6,uj{E) = 19. Therefore the minimum cut is the partition 
T{ U U S, depicted in Figure [5] d). By symmetry, if j > jo then the minimum cut becomes 
Ti U T2 U S", of Figure [S] c). Now these two cuts are not comparable, which contradicts 
implication (fT4 ~ 



Relation (|14|) has been established by L. Guigues in his Phd thesis [B] for affine and 
separable energies, called by him climbing energies. However, the core of the assumption 
(jl3p concerns the propagation of energy through the scales (l...p), rather than affinity or 
linearity, and allows non additive laws (see Section [7]). In addition, the new climbing axioms 
[11] lead to the algorithms of the next section, much simpler than that of [6]. 

The scale sequence has been supposed finite, i.e. with 1 < j < p. We could replace j by 
a positive parameter A G M+. But the induction method for finding the optimal cut requires 
a finite hierarchy H. Therefore the number of the scale parameters actually involved in the 
processing of H will always be finite. 



5 Implementation via a pedagogical example 

We now describe step by step two algorithms for generating a hierarchy of minimum cuts. The 
input hierarchy H comprises the four levels and two energies {^1,^2} depicted in Figure [6l 
The energies of the classes are given along column I, left for A = 1, and right for the energies 
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Figure 6: Column I: initial hierarchy and associated energies (left, for A = 1; right, the 
changes for A = 2); column II: reading order; columns III and IV: progressive extraction of 
the minimum cuts for A = 1 and A = 2, the two final minuma have bold frames. 
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that are different for A = 2. They are composed by supremum (the energies of the three partial 
partitions {a, b, c}, and {e, /} are not decomposed). If class S is temporary minimum for a;^ 
then is remains temporary minimum for all w^, /i > A. The scale of apparition \~^{S) = 
inf{A I S temporary minimum for uj\} is the smallest A for which S" is a temporary minimum. 
A class S which is covered by a temporary minimum class Y at scale ^ remains covered 
by temporary minima at all scales v > ^. The scale of removal X~{S) = min{A"'"(y), y G 
H,S C Y} is the smallest fj, for which S is covered. Therefore, if A+(5') < X~{S), then class 

5 ^ H belongs to the minimum cuts tt^* for all A of the interval of persistence [X'^{S), X~{S)]. 
If X^{S) < A^(S'), then S, non-persistent, never appears as a class of a minimum cut. This 
happens to class g, for which X~{g) = 1 and X'^{g) = 2. 

When the two bounds A"'"(S) and X~{S) are known for all classes S € H then the hierarchy 
of the minimum cuts vr^* is completely determined. They are calculated in two passes as follows 

1- take the nodes following their labels (ascending pass). For node S, calculate the 
two energies ujx of S and of its sons it{S), for A = 1,2. Stop at the first A such that 
^x{S) < ujx{tt{S)). This value is nothing but X~^{S). Continue for all nodes until he top of 
the hierarchy. This pass provides the X~^{S) values for all S £ H. In Figure [6] the sequence 
of the two energies is climbing: when a class is temporary minimum for A = 1, it also does 
for A = 2. Two changes occur from A = ltoA = 2: g and h have now the same energies as 
{a, b, c} and {e, / jrespectively. 

2- The second pass progresses top down. Each class Y is compared to its sons Zi, .Zi, 
and one allocates to each son Zi the new value min{A^(y), A^(Zj)}. At the end of the scan, 
all values X^{S) are known. 

6 Additive energies 

The additive mode was introduced and studied by L.Guigues under the name of separable 
energies [6]. All classes S" of 5 are supposed to be connected. Denote by {T„, 1 < u < q} the 
q sons which partition the node S, i.e. 7r{S) = Ti U ..Tu-. U Tg. Provide the simply connected 
sets of V{E) with energy u, and extend it from Vi^E) to the set P(-E) of all partial partitions 
by using the sums 



All separable energies w are clearly /i-increasing on any hierarchy, since one can decompose 
the second member of implication ([5]) into w(7ri U ttq) = w(vri) + a;(7ro), and uj{7r2 U ttq) = 
uj{iT2) + w(7ro). However, they do not always lend themselves to multiscale structures, and a 
supplementary assumption of affinity has to be added [6], by putting 



function of j. The term uj^ is associated with the interior of A and ajg with its boundary. 
In such an affine energy, the function ujq must be c-additive on the boundary arcs F, in the 
sense of integral geometry, i.e. one must have 




(16) 



1 




uj9{Fi U Fa) + uaiFi n Fa) = a;a(Fi) + ^^(Fs) 



(18) 
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since most of the arcs Fi,F2, ...Fi of the boundaries are shared between two adjacent classes. 
The passage set^ partial partition'^ can then be obtain by the summation ()16p . One clas- 
sically take for ojq the arc length function (e.g. in Rel. (|20]l ), but it is not the only choice. 
Below, one of the examples by Salemenbier and Garrido about thumbnails uses ujq{S) = 1. 
One can also think about another ujq{S), which reflects the convexity of A. 

The axiom (|13p of scale increasingness involves only increments of the energy u, which 
suggests the following obvious consequence: 

Proposition 13 // a family {uj^ , 1 < J < p} of energies is scale increasing, then any family 
{uj^ + loq, 1 < j < p}, where ujo is an arbitrary energy over U which does not depends on j, 
is in turn scale increasing. 

6.1 Additive energy and convexity 

Consider, indeed, in a compact connected set X without holes, and let da be the elemen- 
tary rotation of its outward normal along the element du of the frontier dX. As the radius 
of curvature R equals du/da, and as the total rotation of the normal around dX equals vr, 
we have 

^ f du f du , , 

R>0 R>0 

When dealing with partitions, the distinction between outward and inward vanishes, but the 
parameter 



du 



\R{u) 



ax 

still makes sense. It reaches its minimum 1 when set X is convex, and increases with the 
degree of concavity. For a starfish with 5 pesudo-podes, it values around 5. Now n{X) is 
c-additive for the open parts of contours, therefore it can participate as a supplementary term 
in an additive energy. In digital implementation, the angles between contour arcs must be 
treated separately (since c-additivity applies on the open parts). 

6.2 Mumford and Shah energy 

Let 7t{S) be the partition of a summit S into its q sons {T^, 1 < u < q} i.e. vr(S') = 
Ti U ..Tu.. U Tg. The classical Mumford and Shah energy on 7r{S) and w.r.t. a function 
/ comprises two terms [8]. The first one sums up the quadratic differences between / and 
its average m{Tu) in the various T^, and a second term weights by A-' the lengths (9T* of the 
frontiers of all T^, i.e. 

uj^{7:{S))=Y, I Jl /(x)-m(rj f+A^- ^ (OT„) = a;;.(7r) + A^'a;a(7r) (20) 

where the weight A-' is a numerical increasing function of the level number j. Both increas- 
ingness relations ([5]) and (fT3]) are satisfied and Theorem [12] applies to the additive energy 
(1201). 
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Figure 7: Minimum cuts of the hierarchy Fig. [TJ;, for two compression rates of 25 and 55 
apphed to the luminance ( a) and b) respectively); c) for a compression rate of 55 applied to 
the chrominance. 



6.2.1 Additive energies and Lagrangian 

The example of additive energy that we now develop is an extension of the creation of 
thumbnails by Ph. Salembier and L. Garrido [13] |15j . itself based on Equation ()20p . We 
aim to generate "the best" simplified version of the image / of Fig. [H in its color version of 
components (r; g; b), for the compression rate p ~ 25. The bit depth of / is 24 and its size is 
320 X 416 pixels. The hierarchy H / is that depicted, via its saliency map, in Fig. [TJ:. It 
has been obtained from the luminance I = {r + g + b)/3. In each class S of H, the reduction 
consists in replacing the function / by its mean ni(l) in S. The quality of this approximation 
is estimated by the L2 norm, i.e. 



E 

x&S 



l{x) — m{S) 



(21) 



If the coding cost for a frontier element is c, that of the whole class S becomes 



LogiS) = 24 + - I 95 



(22) 



with 24 bits for m{S), and we take c = 2 for elementary cost. The total energy of a cut tt is 
thus written Lj^{7r) = a;^(7r) + X^ujg{Tr). By applying Lagrange's theorem, we observe that the 
problem of finding the minimum of oj^{'k) under the constraint ujq{'k) ~ 25 implies that the 
Lagrangian oj^{tt) + \^ujq{'k) is a minimum. In this equation, the level j is unknown, but as 
the u)^ are multiscale, we can easily calculate the sequence {vr-'*, 1 < j < p} of the minimum 
cuts. Moreover, the term ^^(vr) itself turns out to be a decreasing function of j and A-', so 
that the solution of the Lagrangian is the vr-'* whose term ujq{'k^*) is the greatest one smaller 
than k. It is depicted in Fig 17] a (in a black and white version). 
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Classically one reaches the Lagrangian minimum value by means of a system of partial 
derivatives. Now, remarkably, the present approach replaces the of computation of derivatives 
by a climbing. Moreover, we have under hand, at once, all best cuts for all compression rates. 
If we take p ~ 55 for example, we find the image of Figl7]b, whose partition is located at a 
higher level in the same pyramid of the best cuts. L. Guigues was the first to point out this 
nice property [6]. 

There is no particular reason to choose the same luminance / for generating the pyramid 
and, later, as the quantity to involve in the quality ()2ip to minimize. In the RGB space, a 
colour vector l^{r;g;b) can be decomposed in two orthogonal projections 

i) on the grey axis, namely I of components {1/3; 1/3; 1/3), 

ii) and on the chromatic plane orthogonal to the grey axis at the origin, namely if of 
components(3/\/2)(2r — g — b;2g b — r;2b — r — g). 

We have 1^ = / + "cf . The optimization is obtained by replacing the luminance l{x) in 
(|2ip by the module | l^{x) \ of the chrominance at point x. We now find for best cut the 
segmentation depicted in Figl7]c, where, for the same compression rate p ~ 55, color details 
are better rendered (e.g. right bottom), but black and white parts are worse (e.g. the letters 
on the labels). 

7 Energies composed by supremum 

We now us go back to Rel.(|16p. and replace the sum by a supremum. It gives: 

g 

oo{S) = (Ti U ..r„.. U T,) = \/u{Tu). 

1 

This time the second member of implication ([S]) is written (^[(vri U vro] = u}{tti) V u^ttq), and 
a;[(7r2 U ttq] = uj{it2) V a;(7ro), so that ui is /i-increasing. The property remain true when V is 
replaced by A. 

7.1 Connective segmentation under constraint 

This method was proposed by P. Soille and J. Grazzini in [f7j and [1^ with several variants; 
it is re- formulated by C. Ronse in a more general framework in |13j . Start from a hierarchy 
H and a numerical function /. Define the energy for class S by 

UJ^ (S) = when sup{/(a;),x E S} — mi{f{x),x £ S} < cP 
uj^ (S) = 1 when not, 

where c-' is a given bound, and extend to partitions by V-composition. The class at point x 
of the largest partition of minimum energy is given by the largest S £ S, that contains x, 
and such that the amplitude of variation of / inside S* be < c' . When the energy of a 
father equals that of its sons, one keeps the father when uj^ = 0, and the sons when not. As 
bound c' increases, the {u}^} form a climbing energy, previously referred to in corollary [?] 
and depicted by the pedagogical example of Figure [8] . 



16 




Figure 8: Function / is segmented by smooth path connections of increasing slopes. Then 
one takes at each point the largest class S with Aj(S') < c (from C. Ronse P^). 



7.2 Lasso 

This algorithm, due to F. Zanoguera et Al. [19j . appears also in [7]. An initial image has 
been segmented into a-flat zones, which generates a hierarchy as the slope a increases . The 
optimization consists then in drawing manually a closed curve around the object to segment. 
If A designates the inside of this lasso, then we take the following function 

uj{S) = when S <Z A ; S €S (23) 
uj{S) = 1 when not, 

for energy, and we go from classes to partitions by V-composition of the energies. The largest 
cut that minimizes uj is depicted in Figure [9j3. We see that the resulting contour follows the 
edges of the petals. Indeed, a segmented class can jump over this high gradient only for a 
large enough, and then this class is rejected because it spreads out beyond the limit of the 
lasso. 

By taking a series {A^ , 1 < J < p} of increasing lassos A^ we make climbing the energy lv 
of Relation ()23p . and Theorem 1121 applies. Unlike the previous case, where the A-' are scalars 
numbers, the multiscale parametrization is now given by a family of increasing sets. 

8 Conclusion 

Other examples can be given, concerning colour imagery in particular [Ij. At this stage, the 
main goal is to extend the above approach to vector data, and more generally to GIS type 
data. 
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^ ^ «l 

Figure 9: a) Initial image; b) manual lasso; c) contour of the union of the classes inside the 
lasso. 
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